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ABSTRACT 



The purpose of this investigation was to test two 
hypotheses concerning the ability of taxonomic tests of cognitive 
processes to differentiate the performance of students from varying 
educational environments in an effort to shed additional light on t 
construct validity of Bloom's Taxonomy. (Author) 
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Although considerable research has focused on the assumptions underlying 
the Taxonomy of Educational Ob.j ec tives : Cognitive Domain (Bloom, 1956) , 

little evidence is available concerning its measured relationships with other 
re 1 e van t , c on t inu ou S r or c at e g or i c al va r i ab 1 es (Cox & Unks , 1967; Kropp, 

Stoker, & Bashaw, 1966; Cox & Wildemann, 1970). The purpose of this 
investigation was to test two hypotheses concerning the ability of taxonomic 
tests of the cognitive processes to differentiate the performance of students 
from varying educational environments in an ef f :: to shead additional light 
on the construct validity of the Taxonomy . 

— Consistent with the cumulative and hierarchical assumptions of the 

Taxonomy. I, L._ Smith ( 1970b) demonstrated that . in-teller tmal-but- nol^creatJLve — 

ability is related to performance on the Know! 'be, Comprehension, Application, 

— - and Analysis subtests, while intelligence plus creativity are related to the 

Synthes is and Evaluation categories'. “The 'Tesulrtrs £pp ear* CD" sup'pcrr t 'TflTe 

g*. conceptualization of tests of the first four and last tv o levels of the 



*• 



, Taxonomy in terms of convergent and divergent processes, respectively. See 

Bloom, Hastings, & Madaus (1971) and I. L. Smith (1970a, 1971) for a further 
discussion of these terms in relation to the Taxonomy. Based on these 

V o 

findings and definitions, it would appear that performance on cognitive process 
tests derived from the Taxonomy should be sensitive to differences in school 

environments. Specifically, it is hypothesized that performance on the 

Knowledge, Comprehension, Application, and Analysis sub tests favors students 

2 ^ 
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attending a conventional-traditional school emphasizing convergent processes, 
while tests of the upper two levels favors those from a more open, spontaneous 
climate. In examining the two hypotheses, the possibility of sex, grade, and 
classroom differences were also considered. 

Metho d 

The two schools selected for study were intended to reflect maximum 
differences in educational environments (see Table 1) . 



INSERT TABLE 1 ABOUT HERE 



School A, defined as the open, spontaneous t (OS) educational environment, is a 
private school designed for the education of the academically talented. 
Admission requirements include high scores on a s tandardized tes t administered 
by - the^sictrcrol "and "a at least 130 on the Wechsler InfeTligence Scale 

£ o r— Chil. d ra n_(WXS_G) Th e re— was — some -queati on— as to wh e-b her th e l a-t-Ler 



criterion was actually met in most cases. The WISC scores obtained by the 



school ! s headmaster bore little relationship to scores on theXorge-Thorndlke” 



Intrel ILgmTc^e^res't , Level Lr^ t_orm l , collec te d _dur i n g th e_ c o ur se^ ot the s tudy __ 



(r=.40). In addition, the students averaged approximately 10 IQ points less 



on the Lorge-Thorndike . It would appear that the determination of WISC scores 
by the headmaster may have been spuriously high and/or a reflection of factors 
other than those related to intelligence. 

School B, designated as the conventional-traditional (CT) educational 
e nv i r onme nt , JL^ a pjjblic senior h Lgh sch o o.l _X ocat c dL_ ln_a^woxki ng _ c la s s_s uburh A _ 



Mos t s ub je ct-matter- ^^e a s -ar-^ -ef fered — a 
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one and two are for the average and below average students, while tracks 
three and four are sections for the college bound. 

The sample consisted of 20 randomly selected students (10 male, 10 female) 
from each of two randomly selected social studies classrooms at both the 10th- and 
llth-grade levels at both schools. In an effort to achieve comparable IQ 
levels among the groups, only track four classes were sampled at School B. 

Each subject was administered the Lorge-Thorndike Intelligence Test, Level G, 

Form 1, and a taxonomic test of the Stages of Economic Development. The latter 
test was selected from the work of Kropp et al. (1966) on the construction 
and validation- of tests derived from the Taxonomy . Their data clearly support 
the irnpu ted hierarchical structure of the Taxonomy . Additional cross- 
validational evidence is supplied by R. B. Smith (1968) and I. L* Smith (1970a) . 
The test consists of six subtests corresponding to the major levels of the 
Taxonomy . All questions are based on he reading of a passage called 
The Stages of Economic Development. This material was selected on the basis 
of interest, ease of comprehension, and most importantly, its unfamiliarity 
to the students participating in the study. Social studies teachers in both 
schools examined the passage and concluded that the content was not part of a 

formal course of instruction nor could it be found in text books nor mally 

a irahte enTsT’*"' P arTT one of ^the"Two -par t^ tes t consis ts of' the 

Knowledge, Comprehension, Application, and Analysis subtexts, each containing 
20 mult iple— choice questions- The second part includes five open-ended 
Synthesis and 10 open-ended Evaluation questions. 

o 

The design for the analysis was a two (schools) x two (grades) x two (se.x) 
x two (classrooms nested) analysis of covariance. Since classrooms were 
randomly selected, the nested factor represented a random dimension. All 
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other main effects were regarded as fixed. Since performance on tests of 
the cognitive processes is affected by general aptitude (Smith* 1970a, 1970b, 
1971), scores on the Lorge-Thorndike Intelligence Test were employed as a 
covariate. The analyses were performed using a computer program written by 
Finn (1968). 

Results 

The cell means for the taxonomic tests and the Lorge-Thorndike Intelligence 
Test are presented in Table 2 and the results of the analyses of covariance in 
Te^l^S' 3 and 4. 



INSERT TABLES 2, 3, and 4 ABOUT HERE 



The results concerning the hypothesis that performance on the first four 
taxonomic levels favor students from the <JT environment is supported only in 



the case of the Knowledge and Comprehension subtests. Contrary to the 
“hypo t hes±s~, n o rgni ficairt differenc es - due — ti 
on the Application subtest, while performance on the Ana .Iosifs 1 vel test 
significantly favored ^ndf aLo j_ . 



.he OS climate. As might be expected, the 



tests of the f irs t - four -levels -appear— to be- sensitive -to -developmental 



differences since llth-graders performed significantly better than lOth-graders 
on the Knowledge, Application and Analysis subtests. Sex differences favoring 
males also appears, but only with respect to the Application level les L. The 
significant School x Sex x Grade interaction on Knowledge indicates t: at in the OS 
environnn. ?il ? lOth-grade males performed better than 10th -grade female , but than 

females surpassed males at— the— 11 th-grade . In -the-GT-envir-onraent-j-rntMes -surpassed - 

Tf e mal gs~Ta LVlbTdXiu <zr ade~ TidveXllIIIl - - ^ I — ■ -- ~ ~ : : 
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The findings concerning the upper levels of the Taxonomy are supported; 
performance on the Synthesis and Evaluation sub -tests favors students from 
the OS climate. While developmental differences again appear, indicating that 
11th graders performed significantly better than 10th graders on the Synthesis 
level test, the Ordinal Grade x Sex interaction suggests the best performance 
on this subject is demonstrated by 11th grade females. This latter finding 
is also reflected in the fact that females in general performed significantly 

c 

-■'better on the Synthesis subtest, while males in general demonstrate significantly 
better performance on the Evaluation subtest . 

j- n summary^ tfie^ Ifi ndirigs “appear t o~be both confirming and rejecting of 

.. the hypotheses ' While differences due to school environment appear to be the 

strongest with respect to the magnitude of the effects, two of the six predicted 
relationships (Application, Analysis) were not supported. The significant 
developmental, sex, and interactive effects generally do not appear to exhibit 

a great deal of strength re lative to' the effect of school environment .' These 

— differences may also be viewed as a function of the particular model (mixed) 

under which the data were analyzed. If a fixed model analysis of variance had 

been employed, only the effects of school environment would have been significant 

The general findings do indicate that the lower level processes favor students 

' f rom t he GT climate ,_while_.jthe upper level .processes -favor.. those from the_QS. 

climate. What is apparently needed, then, is a. conception, of. the ..taxonomic, 
processes that integrates both the positive findings. 

Discussion 

c % o 

Appropriate interpretation of the findings requires a consideration of 
the meaning of the term school environment as it is employed in the present 
study. Since students were not randomly selected and assigned to school 
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environments, but identified after designation on this dimension had been made, 
it is likely that selection factors were operating. For example, application 
for admission to School A, the OP environment, could not be considered a 

c 

random process. The testing for admission could also have involved the 
intentional selection of students on the basis of personality and motivational 
factors v ^The IQ scores for these students may have been inflated so as to permit 
entry. This might explain the discrepancy in performance on the Lorge-Thorndike 
and WI&C. In addition, there is the possibility that the attrition rate was 

* t O f . 

greater for students who found it difficult to work in an unstructured situation 
as opposed to those who did not. All of these considerations indicate that the 
question as to whether the OS and CT environments facilitate different cognitive 

processes cannot be answered with these data. One simply does not know whether 

the differences identified are a function of school environment, pre-selection 
factors, non-random attrition rates, or a combination of all of these. The 



_$ ame considerations Hold with "respect to the hyp ot heses _ Whil n 



clearly indicates that the taxonomic tests are sensitive to students. in 



:iniR the” ”di f fe rence s in peFTormance c aim ot be att rib ut e dF 



to the effect of s chop Tf environ men ta lone , Tb'ufTm.us t_ lhclude^ reference to the - 

o 

possiblity of otherXausal" f actors Sin ce^ the~se confo iindin gi f act n r s^-pnoh aK Iy~ I 

se rv e'd”tfo create a greater contrast in the two student populations than would 
have been expected under - conditions- of random selection and assignment of students 
to environments, the difference identified in the present study may be spurious ly high . 

Within 'the' limit ^specified above, the mixed nature of the results indicate 
that the conceptualization of taxonomic levels in terms of covergent and 
divergent processes is neither supported or rejected. However, it does appear 

that an a lte rn ate^int e - the"cbmpiexity of Kirp ¥oco s se s an d 

their demands for independent-autonomous functioning may provide a more approprieite 
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explanatio n of the findings. The complexity hypotheses is the one on which 
the Taxonomy was originally developed (Bloom, 1956). Given this view, the 
processes can be classified from simple to complex, specifically based on a 
dimension demanding increased independent behavior. For example, the less 
complex processes (Knowledge, Comprehension) require little independent thinking, 
while the more complex processes (Analysis, Synthesis, Evaluation) require a 
high degree of independent thinking. This interpretation appears consistent 
with the findings, since it may be reasonable to assume that School A operates 
in such a way as to require more independent behavior from its students than 
School B . The results, then, seem to favorably reflect on the construct validity 
of the Taxonomy , with the notion of dual processes (convergent -divergent ) receiving 
less support than the complexity hypotheses on which the Taxonomy was originally 



constructed . 
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Table 1 



Summary of Differences in 
Educational Environment 



Cri terion 


Conventi onal - 


Open- 


c 


Tradi ti onal 


Spontaneous 


Type of Institution 


Pubi i c 


Private 


Average CTassSi zes 


30-45 


10-25 


. - Teaching Styles 


Formal - 


Informal - 




- Didactic 


Di scussi on 


Extra Class Contact 






- With Teachers, Private 


Rare 


Frequent 


Conferences, Informal 






Chats , etc. 






: Administrative Control 


- 


- - 


Over Student Time 


Present 


Absent 


Competition 


Inter- 


" Jntrzi= 


. 


indi vidua! 


individual 


: — — - — - 








■ — - . - • - 




. .... _ — ... .. — - — — 
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Table 2 

Cell Means for the Taxonomic 
Tests and the Lorge- 
Thorndike IQ Test 



School A School B 



Grade 


10 


Grade 


11 


Grade 


10 


Grade 11 

- 1 - 


Class 1 


Class 2 


Class 3 


Class 4 


Class 5 


Class 6 


Class 7 


Class 8 




16.7 


16.9 


17.0 


17.2 


18.1 


18.7 


19.5 


19.2 




11 .0 


10.6 


11 .2 


11 .5 


13.0 


12.2 


12.9 


13.1 




10.9 


.11.1 


11.4 


11 .0 


11.6 


11 .5 


12.2 


11.9 




7.0 


7.1 


7.6 


7.4 


6.9 


6.7 


6.8 


6.6 




6.3 


6.2 


6.4 


6.7 


5.2 


5.1 


5.5 


5.2 




5.4 


5.6 


5.6 


6.1 


2.9 


2.8 


3.2 


3.4 




122.6 


119.2 


120.3 


123.6 


121 .0 


124.2 


124.2 


120.8 




16.4 


16.8 


17.3 


17.1 


18.4 


18.2 


19.0 


18.7 




10.9 


10.1 


11.1 


11.0 


12.8 


12.4 


12.6 


13.2 




10.4 


10.9 


11.3 


10.9 


. 11.0 


10.9 


11.8 


11.3 


s 


6.8 


6.8 


7.0 


7.7 


6.2 


6.4 


6.9 


6.9 




6.6 


6.8 


7.3 


7.5 


4.9 


4.8 


5.3 


5.3 




4.9 


5.0 


5.1 


5.8 


3.0 


3.0 


3.1 


3.5 




121 .7 


123.6 


122.5 


124.6 


123,4 


.123.1 


122.8 


124.6 




' ■ - 


■■ •- - r - ■■■■ ■■ •' 


n — 






| 


1 



N OTE - The mean crnrPQ fny- P3rh rpll av'P 

order: Knowledge, Comprehension, Application, Analysis, Synthesis, 

Evaluation, and IQ 
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TABLE 3 

ANALYSIS OF CO-VARIANCE FOR THE FIRST FOUR LEVELS 

OF THE TAXONOMY 



SOURCE 


df 




KN 


CO 




AP 




AN 


MS 


F 


MS F 




MS 


F 


MS 


F 


School (S) c 


1 


103.8 


66.3* 


*95.1 24 


.1* 


12.7 


2.2 


10.0 


4.0* 


Grade (G) a 


1 


12.1 


17.2* 


8.0 2 


.8 


8.9 


8.9* 


4.0 


40.0* 


Sex (SE) b 


* 1 


1.9 


4.0 


.7 . 1 


.4 


4.5 


43.4* 


.5 


.7 


Classrooms (C) c 


4 


.7 


.4 


2.9 


.8 


1.0 


.2 


.1 


.4 


Nested 




















S X G c 


... 1 


,9- 


1 .4 


5 


.2 


.2 


.2 


.4 


4.1 


S X SE C 


1 


.1 


.1 


2.2 


.6 


.9 


.2 


4.3 


1.7 


G X SE b 


1 


.1 


- .1 


.1 


.1 


.3 


2.9 


1 .6 


2.0 


S X G X SE C 


1 


7.3 


4.7* 


.1_ 


.0 


1 .4 


.2 


.4 


.2 


• — SE X C c 


4 


.5 


.3 


.5 


.1 


.1 


.0 


. 8 . 


.3 


Within 


143 


1.6 




3.9 




_ . 5.8 




_2. 5- 




— : 












-- ~ 


• - - - 


• 


" ’ 


— Note: KN, 


CO, AP, 


and AN 


refer to 


Know! edge , 


Comprehension, Application, 


and Analysis, r 


especti-velvu — Val ues— atra— rounded-to 


-the- 


-raeares-t— tcmtfrr 


— fstt 


irates 



of appropriate error mean squares were derived through procedures suggested by 
Cornfield and Tukey (1956). 



— ~*P <-.05 



Nested "Ta c t o r _ emp 1 oyed ~a s error term, 
k Sex X classrooms interaction employed as error term. 
c Within cell variability employed as error term. 
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TABLE 4 

ANALYSIS OF COVARIANCE FOR THE UPPER TWO LEVELS 
OF THE TAXONOMY 



- SOURCE 


Q T “ 


MS 


F 


MS 


F 


School (S) c 


l 


120.6 


11.9* 


248.7 


38.1* 


Grade (G) a 


l 


5.1 


24.7* 


3.9 


3.5 


Sex (SE) b 


l 


.9 


30.7* 


1.1 


13.6* 


Cl ass rooms 
Nested (C) c 


4 


.2 


.0 


1 .1 


.2 


S X G c 


1 


.0 


.0 


.21 


.0 


S X SE C 


1 


4.0 


.4 


5.5 


.8 


G X SE b 


1 


.9 


34. 4 = * 


.0 


.0 


S X G X SE C 


1 


.3 


.0 


.6 


.1 


SE X C c 


4 


.0 


.0 


.1 


.0 


Wrtb-fn 


-143 — 


T0r4 — 




6-.-5 






NOTE. - SY and FV refer to Synthesis and Eva.1 uatioJ i^_re_s pective 1 y 

Values are rounded to the nearest tenth. Estimates of appropriate 

error mean squares were derived.. through^procedures . suggested by 

Cornfield and Tukey (1956) . 

— ;*p~<-r05 — • • ~ ' - 

a Nested factor employed as error term. 

b Sex X Classrooms interaction employed as 
error term. 

c Within cell variability employed as error term. 



